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Abstract 

In various problems of control theory, non-autonomous and multival- 
ued dynamical systems, wavelet theory and other fields of mathematics 
information about the rate of growth of matrix products with factors 
taken from some matrix set plays a key role. One of the most prominent 
quantities characterizing the exponential rate of growth of matrix prod- 
ucts is the so-called joint or generalized spectral radius. In the work some 
explicit a priori estimates for the joint spectral radius with the help of the 
generalized Gelfand formula are obtained. These estimates are based on 
the notion of the measure of irreducibility (quasi-controllability) of matrix 
sets proposed previously by A. Pokrovskii and the author. 
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1 Introduction 

In various problems of control theory 9], non-autonomous and multivalued dy- 
namical systems [2-4], wavelet theory [11, 12, 14] and other fields of mathematics 
information about the rate of growth of matrix products with factors taken from 
some matrix set plays a key role. One of the most prominent values character- 
izing the exponential rate of growth of matrix products is the so-called joint or 
generalized spectral radius. The aim of the paper is to obtain efficient explicit 
estimates of the joint spectral radius. 

Let s/ = {A±, . . . , A r } be a set of real m x m matrices. As usual, for n > 1, 
denote by s/ n the set of all n-products of matrices from s/ ; s/° = I. 
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Let || • || be a fixed but otherwise arbitrary norm in M. d . Then the limit 

p[sf) =limsup|K rl || 1 /™, (1) 

where 

|K™|| = max \A\\ = max || A in ■ ■ ■ A i2 A il ||, 

is called the joint spectral radius of the matrix set si |35J. In fact, the limit in 
(1) does not depend on the norm || • ||. Moreover, for any n > 1 the estimates 
p(si) < || si n || 1 /™ hold 35] , and therefore the joint spectral radius can be defined 
also by the following formula: 

p{si) = inf K"|| 1/n . (2) 

n>l 

If the matrix set si consists of a single matrix then (1 ) turns into the known 
Gelfand formula for the spectral radius of a linear operator. By this reason 
sometimes (1) is called the generalized Gelfand formula [37]. 

For each n > 1 it can be defined also the quantity 

pn{#f) = max p{Ai„ ■ ■ ■ A i2 A il ), 

Ai 

J 

where maximum is taken over all possible n-products of the matrices from the 
set si, and p(-) denotes the spectral radius of the corresponding matrix, that is 
the maximum of modules of its eigenvalues. In these notations the limit 

p{si) =limsup(p„K)) 1/n (3) 

n— >oo 

r 1 I 1 

is called the generalized spectral radius of the matrix set si 1 12, 13]. Moreover, 
for any n > 1 the estimates p(s/) > (p n (£^))) 1 ^™ hold, and hence the generalized 
spectral radius can be defined also as follows: 

pK) = sup(p„(^)) 1/n . (4) 

n>l 

As is shown in [6, Thm. 2], see also [15, 36, 37], the quantities p(s/) and 
p(s/) coincide with each other if the matrix set srf is bounded. This allows to 
speak simply about spectral radius of which will be denoted in what follows 
as p(sf) (= p{sf) = p{sf)). 

In view of (2), (4) for any n the quantities (p n (^/)) 1//n and || ^e/ 71 1| 1 / rl form 
lower and upper bounds, respectively, for the spectral radius of si : 

(Pn(^)) 1/n <p(^)<\\^ n \\ 1/n . (5) 

This last formula may serve as the basis for a posteriori estimating the accuracy 
of computation of p(s/). The first algorithms of a kind in the context of control 
theory problems have been suggested in |9], for linear inclusions in 4], and for 
problems of wavelet theory in |11, 12, 14]. Later the computational efficiency 
of these algorithms was essentially improved in [16, 27]. Unfortunately, the 
common feature of all such algorithms is that they do not specify the amount 
of computational steps required to achieve desired accuracy of approximation 
of p(s/). 
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In 15, 35] it was proved that the spectral radius of the matrix set srf can be 
determined by the equality 

p(^)=inf|M|, (6) 

where infimum is taken over all norms in M. d . For irreducible matrix sets 1 s$ 
infimum in (6) is attained, and for such matrix sets there are norms || • || in M. d , 
called extremal norms, for which 

IMI<pK). (7) 

In various situations it is important to know the conditions under which 
p{jrf) > 0. To answer this question, in general case one can use, for example, 
Theorem A from [8] , which claims the existence of a constant Cd > 1 depending 
only on dimension of a space such that for any bounded matrix set si and any 
norm || • || in M. d the following inequality holds: 

\\^ d \\<C dP {^)\\^\\ d -\ (8) 

From here it follows that the equality p(&?) — implies the equality \\^ d \\ = 0, 
and then also the equality srf d — {0}. In virtue of (2) the converse is also valid: 
stf d = {0} implies p{&?) = 0. So, theoretically verification of the condition 
p{s?) — may be fulfilled in a finite number of steps: it suffices only to check 
that all (i-products of matrices from srf vanish. Of course this remark is hardly 
suitable in practice since even for moderate values of d = 3, 4, r = 5, 6 the 
computational burden of calculations becomes too high. 

Remark that by (7) p(s/) > for irreducible matrix sets s/. 

Some works suggest another formulas to compute p(-s/). So, in [10] it is 
shown that 

p(£/) = limsup max \tr(A in ■ ■ ■ A io A h )\ 1/n , (9) 

n->oo A ij e-e^ 

where as usual tr(-) denotes the trace of a matrix. In 28, 33, 34] L p -general- 
izations of the formulas (2), (4), (9) and (6) are proposed for computation of 
the spectral radius of matrix sets. Algorithms for computation of p{srf) based 
on the relation (6) are considered, e.g., in [17, 18, 28]. In [29] it was noted 
that the norm in the definition of the joint spectral radius can be replaced by 
a positive homogeneous polynomial of even degree. By developing further this 
idea one can replace the norm in (1) by an arbitrary homogeneous function 
strictly positive outside of zero. Namely, let v{x) be a strictly positive for x ^ 
homogeneous function with degree of homogeneity x > 0, that is v(tx) = t >c v{x) 
for any t > 0. Then by introducing for an arbitrary matrix A the notation 

v(A) = sup 

one can easily get the following generalization of formula (1): 

9 {sf)= limsup K(^)) 1 ^", (10) 



1 A matrix set jz/ is called irreducible, if the matrices from i</ have no common invariant 
subspaces except {0} and R m . 
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where 

v n {&f)= max v(A in ■ ■ ■ A i2 A h ). 

As is shown in 1 29] , in a number of situations (10 ) gives a better approximation to 
p(s/) because the collection of positive homogeneous functions is richer than the 
collection of norms. In particular, the Lebesgue sets 2 of positive homogeneous 
functions may be non-convex in contrast to the Lebesgue sets of norms. 

In [7] it is established that in the case when all matrices from have non- 
negative entries the following inequalities hold 

_L_ p l/n( A ®n + . . . + < < p l/«(Af ™ + • • ■ + Af n ), (11) 

where A®" denotes the n-fold Kronecker (tensor) product of the matrix A with 
itself. Here the fact that the right-hand and left-hand sides of the inequalities 
(11) do not contain mixed products of the matrices from srf looks somewhat 
surprising. Theoretically, the inequalities (11) allow to compute p(s/) with any 
desirable accuracy. However, dimension of the matrix Af n + • ■ ■ + Af n increases 
in n so rapidly that even for moderate values of d = 3, 4, r = 5, 6 computations 
become practically impossible. In the general case of arbitrary matrix sets &/ a 
bit more complicated analog of formula (11) is also valid |7]. 

In investigation of properties of the spectral radius of matrix sets some im- 
plicit definitions of the joint (generalized) spectral radius play an important 
role. Let the matrix set si be irreducible. Then [4] the value of p equals to 
p(s/) if and only if if there is a norm || • || in K m such that 

p||a:|| = max \\Aix\\. (12) 

The norm satisfying (12) is called the Barabanov norm. Similarly 32, Thm. 3.3], 
34], the quantity p equals to p(s^) if and only if for some central-symmetric 
convex body 3 S the following equality holds 

pS = conv(^\jA i s\, (13) 

where conv(-) stands for the convex hull of a set. As is noted by V. Protasov 
in 1 32], the relation (13) was proved by A. Dranishnikov and S. Konyagin, so 
it is natural to call the central-symmetric set S the Dranishnikov- Konyagin- 
Protasov set. The set S can be treated as the unit ball of some norm || • || in R d 
(recently this norm is usually called the Protasov norm). As Barabanov norms 
as Protasov norms are the extremal norms, that is they satisfy the inequality 
(7). In [30, 31, 40] it is shown that Barabanov and Protasov norms are dual to 
each other. 

Remark that formulas (6), (12) and (13) define the joint or generalized spec- 
tral radius for a matrix set in an apparently computationally nonconstructive 
manner. In spite of that, namely such formulas underlie quite a number of the- 
oretical constructions (see, e.g., 5, 20, 21, 29, 39, 40]) and algorithms 33] for 
computation of p(s/). 

2 The Lebesgue set of a function v(x) is the set {x : v{x) < c} for some c. 
3 The set is called the body if it contains at least one interior point. 
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In 29] it was noted that the quantity p is an upper bound for p(srf) if for 
some strictly positive homogeneous polynomial p{x) of degree 2d the following 
inequality holds: 

max p(Aix) < p 2d p(x), ViG M. d . 

By using this observation, in [29] algorithms for evaluating of the spectral radius 
p(srf) were developed which are computationally no less efficient and accurate 
than those proposed in [7] . 

As is shown in [41, Lem. 2.3], [39, Lem. 6.5], 32, Sec. 5.2], [33, Thm. 3], see 
also the survey in 38], for irreducible matrix sets srf the following inequalities 
are valid: 

7 l/n||^n||l/n < p( y) < ||^n||l/ n (14) 

for a suitable constant 7 e (0, 1). Some computable estimates of the constant 
7 are obtained in 32, Sec. 8]. 

When the matrix set si is not irreducible the situation is more complicated. 
In this case, by the Bochi inequality (8), p(s/) may vanish, which happens if 
and only if s/ d = {0}. But if p(sf) ^ then [41, Lem. 2.3] 

^ 1+hin)/n \\s/ n \\ 1 / n < p(srf) < IK"]! 1 /" (15) 

with some constant 7, 6 (0,1), which is weaker than (14). Unfortunately, 
39, 41] contain neither exact values nor at least effectively computable estimates 
for 7*. 

The work is organized as follows. In Introduction we have presented a con- 
cise survey of publications related to the problem of evaluation of the joint 
(generalized) spectral radius. In Section 2 the technique by V. Protasov to get 
potentially computable estimates of the joint spectral radius is described. In 
Theorem 1 from Section 3 we obtain new a priori estimates of the joint spectral 
radius based on the notion of the measure of irreducibility (quasi-controllability) 
of matrix sets proposed previously by A. Pokrovskii and the author. Section 4 
is devoted to the proof of Theorem 1. At last, in Section 5 we cite examples 
from 1 26] , which demonstrate how the value of the measure of irreducibility for 
some matrix sets can be evaluated. 



2 Protasov Estimates 

Throughout the paper sf = {A\, . . . , A r } is an irreducible set of real d x d 
matrices. Provided that p(s/) — 1, one can derive from j 32J the following 
estimate for the constant 7 in (14): 

7 > v^y--v^\ (16) 

in which the quantities pi{s$), . . . ,pd~i(s/) are determined by the equalities 

Pk(-s^) — inf sup max dist(AiX, L), k = 1, 2, . . . , d — 1, 

LcR m x£i Ai ^^ 

dimL=fc ||a;||=l 
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where the external infimum is taken over all subspaces L C M d of dimension k, 
|| • || is the Euclidean norm 4 in M. d , and dist(j4jic, L) denotes the distance from 
the point AiX to the subspace L, that is dist(Ajir, L) = infj, e L \\AiX — y\\. 

As is noted in [32], all the quantities pi(sf), . . . ,pd-i{sf) are strictly positive 
since due to irreducibility of s/ the matrices A\ , . . . , A r have no non-trivial 
invariant spaces. Thus, the quantity 7 characterizes, in a sense, a 'degree of 
irreducibility' of the matrix set s/. 

If p(s/) 7^ 1 then the estimate for the constant 7 can be derived from the 
already proven inequality (16) by applying the latter to the matrix set 

a/' = p-\s/)s/ = {p- 1 (s/)A 1 , . . . , p -\sf)A r }, 

- 1. In this case the constant 7 in (14) can be estimated from 

(l + p-^)\\^\\) d - 1 (p(s/)+\\s/\\) d - 1 ' 

and, if to take into account that by (5) p(s/) < \\s/\\, then 

Pijsf) ■ ■ -pd^xjsf) 
(2\\s/\\) d - 1 

3 Main Theorem 

Our aim is to obtain one more explicit a priori estimate of the joint spectral 
radius with the help of the generalized Gelfand formula. Such an estimate might 
have many implications in the area of the joint spectral radius. In particular, 
knowledge of the constant 7 might be useful in evaluating the local Lipschitz 
constant of the joint spectral radius at an irreducible inclusion 39]. 

Denote by s/ n for n > 1 the collection of all finite products of matrices from 
s/{J{I}, consisting of no more than k factors, that is s/ n — U^. =0 s/ k . Then 
s/ n (x) denotes the set of all the vectors Ax where A 6 sf n . Let || • || be a norm 
in R d ; the ball of radius t in this norm is denoted by S(t). 

Let us call the p-measure of irreducibility of the matrix set s/ (with respect 
to the norm || • ||) the quantity Xp(^) determined as 

Xp(^) = hif sup{t : S(t) C conv{s/ p (x) U sf p (— x)}}. 

||x||=l 

Under the name 'the measure of quasi-controllability' the measure of irre- 
ducibility Xp(^) was introduced and investigated in 22-26] where the over- 
shooting effects for the transient regimes of linear remote control systems were 
studied. The reason why the quantity Xp{^) g°t f ne name 'the measure of 
irreducibility' is in the following lemma. 

Lemma 1. Let p > d — 1. The matrix set si is irreducible iff Xp{^) > 0. 

4 Formally, the norm || ■ || in 32] is not assumed to be Euclidean. However, to estimate 
the quantity H = 7~ x in 32, Thm. 8.2] the author uses the notion of perpendicularity of 
subspaces and evaluates the area of a triangle with sides measured by the norm || ■ ||, which 
implicitly mean that the norm || ■ || is Euclidean. 



for which p(sf ) 
below as follows: 

1> P ~ 
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The proof of Lemma 1 can be found in [25, Thm. 2.4], [26, Thm 1.4], [23, 
Thm. 2]. 

Theorem 1. For any n > 1, p > <i — 1 </ie following inequalities are valid 

p(^) <\\^ n \\^ n < ( Vp (^)) 1/n p(^), (17) 



where 



max{l,W^)f} 
%(-0 = " 



and therefore 



whe 



M*or 1/n K n u 1/n < pK) < (is) 

max{l, Kf} 

^ = X P K) • 

Remark that while computation of ?7p (&f) requires the knowledge of the value 
of p(£^), which is a priory unknown, the quantity v p (srf) can be evaluated in 
a finite number of algebraic operations involving only information about the 
entries of the matrices from srf ' . 



4 Proof of Theorem 1 

The proof of Theorem 1 follows the idea of the proof of Theorem 2.3 from 26], 
see also [25, Thm. 2.3], [23, Thm. 4]. 

As was noted above the estimate p(^) < ^"H 1 /™ follows from (2). There- 
fore only the estimate \\stf n \\ 1 / n < (^(g/)) 1 ^ p(s/) needs to be proved. Sup- 
pose the contrary. In this case, for some n > 1, 

\\*rt' n > (v P (^)) 1/n p(*0, 

or, what is the same, 

\\*f n \\ > r] p {^)p n (*f). 
Then, by definition of \\&/ n || , there are matrices , A; 2 , . . . , Ai n £ srf for which 

\\A in ...A i2 A il \\ = \\^\\>r ]p {^)p n {srf). 
Hence, there is a non-zero vector i, such that 

\\A in ••• A i2 A h x4 > rj p (^)p n (ssf)\\x4. 
It is convenient to rewrite this last inequality in the following form 

\\A ln ---A l2 A n x4 >/iri P {j2f)p n (£/)\\x m \\, (19) 

where p is some number strictly greater than unity: p > 1. 

To complete the proof of Theorem 1 we will need two auxiliary statements. 
Denote by x/oo the collection of all finite products of matrices from that 
is £/oo = Uk>i^ k - For each matrix A £ .e^o the amount of the factors 
Ai, A<i, . . . , A q £ in the representation A — A\A% ■ ■ ■ A q is called the length 
of A and is denoted by len(A). 
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Lemma 2. Given p > d — 1 and the irreducible matrix set . Let for some 
i, ^ £ M. d , F £ jz/qo and > t/ie inequality 

\\Fx*\\ > v\\x*\\, (20) 

hold. Then for any i/0£ W 1 there is a matrix F x = FL X G such that 
len(F) < len(F x ) < len(F) + p and 

\\F x x\\ > v Xp {^)\\x\\. 

Proof. Choose a fixed but otherwise arbitrary vector x £ K d . By definition of 
the measure of irreducibility the vector Xp(^/)||x»|| _1 a;» belongs to the centered 
convex hull of the vectors s/ p (||x|| _1 a;). Then there exist numbers 6*i, 02, ■ ■ ■ , 

e s , 

s 

i=l 

and matrices G-y , G2, ■ ■ ■ , G s € stf p such that 

s 

^2e l \\ x \\' 1 G l x = x P 0<)||a;*irV. 

Therefore 

s 

i=l 

from which by ( 20) 

s 

^2\\eiFGix\\>uxp{^\\x\\. 

i=l 

Then by (21) there is an index i, 1 < i < s, for which the matrix F x = FGj 
satisfies the inequality 

\\F x x\\ > vx P W\\x\\. 

It remains to note that due to G; € .0^, independently of x the length of the 
matrix F x = FGi does not exceed the length of the matrix F augmented by p, 
that is len(F) < len(Fj;) < len(F) +p. The lemma is proved. □ 

Lemma 3. Let for some set of matrices , Ai 2 , . . . , Ai n 6 the inequality 
(19) hold. Then for any x /Oel 11 there is a matrix F x 6 s^oo such that 
n < \en(F x ) < n + p and 

\\F x x\\ > W^)) 1 *' ||z||, (22) 

where rj = > 1. 

Proof. Set ^ = nr)p(stf) p n (stf) . Then by Lemma 2 for any x ^ € M d there ia 
a matrix F x <E s^oo such that n < \en(F x ) < n + p and 

\\F x x\\>w P (z/) Xp (^)p n (^)\\x\\, 
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which is equivalent, by definition of rj p (s/), to the following chain of relations 

.. „ maxjl, p p (s^)\ , „ „, ,, 
\\F x x\\ > fi 1 - X P (^)p n (^)\\x\\ = 

As is easy to see, by the inequalities n < len(F x ) < n +p as the first as the 
second factors in the right-hand part of (23) are greater than or equal to 1, from 
which the required inequality (22) follows. □ 

Lemma 4. Let for some set of matrices , Ai 2 , . . . , Ai n 6 si the inequality 
(19) hold. Then there is a sequence of matrices £ , k = 0, 1, . . . , for which 
lcn(iifc) — > oo as k —> oo and 

\\H k \\ > (vp(^)) lcn{Hk) , fc = 0,l,.... (24) 

Proof. Let us choose a non-zero but otherwise arbitrary vector x G M. d , and 
construct an auxiliary sequence of the vectors {x(k)}, k — 0, 1, . . ., by setting 
x(0) = x, 

x(k + 1) = F x ( k) x(k), fe = 0,l,..., 

where is the matrix defined in Lemma 3. Then by Lemma 3 the following 
relations hold: 

||^(fc + 1)|| = H^ffe)^^)!! > (^c^)) 1011 ^^^ ||^(fc)||, fc = o,i,... , 

from which 

\\F x(k) ■ ■ ■ F xW F m x(0)\\ > 

(7 yP (^)) lcn(F ^ fe » )+ - +lon( ^( 1 » )+lon( ^( ( " ) ||x(0)||, k = 0, 1, . . . , (25) 

By setting now 

Hk = -Fx(fe) • • ••P , x(i)-F , x(o); fc = 0, 1, ... , 

from (25) we get 

||^(0)|| > ( W K)) lcn(Hfc) HxWII, fc = 0,l,... , 

which imply the required estimates (24). The lemma is proved. □ 
We now complete the proof of Theorem 1. By Lemma 4 the inequality (19) 
implies the existence of such a sequence of matrices Hk 6 si, k = 0,1,..., 
for which the estimates (24) hold. Then, by setting n k = lcn(Hk) from the 
definition of ||^/™|| we get 

\\^ n *f/ n * > \\H k f' nk > T)p(£f). 

Passing here to the limit in the left-hand part as n k — > oo we obtain: 

p{sf) = limsup|K"|| 1/n > limsupll-t/'^H 1 /"' > vp(^), 
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which is impossible since 77 > 1 and the value of p(stf) is strictly positive for 
any irreducible matrix set (the latter follows, for example, from the inequality 
(7) valid for some extremal norm). The obtained contradiction completes the 
proof of the estimates (17). 

It remains only to note that the estimates (18) directly follow from (17) and 
the inequality p{srf) < \\^\\ valid by (5). 

The proof of Theorem 1 is completed. 



5 Comments and Examples 



Remark that with one trivial exception Theorem 1 is inapplicable for matrix sets 
consisting of a single matrix. This is because a singleton matrix set srf = {A} 
may be irreducible only in the case when A is a matrix of dimension 2x2, and 
also it has no real eigenvalues. 

In a sense, irreducibility of matrix sets naturally arising in control theory 
is similar to the Kalman 'complete controllability plus complete observability' 
property. 

Consider, in particular, a real d x d matrix A = (dij) and column- vectors 
b, c G Mr. Form with their help the matrix set = &/(A, b, c) = {A, Q} where 
Q = (q-ij) — bc T is the matrix with the entries q.- L j — biCj, i,j — l,...,d. Then 
the matrix set £&{A, 6, c) is irreducible if and only if the pair (A, b) is completely 
controllable and the pair (A, c) is completely observable by Kalman [26]. 

Reproduce a pair of examples from [26] which demonstrate how to verify the 
irreducibility of a matrix set and how to evaluate its measure of irreducibility. 
Proofs of the corresponding statements can be found in [26] . The next example 
came from the theory of asynchronous systems, see, e.g., 1, 19]. Given a real 
d x d matrix A = (ay), form the matrix set &(A) = {A\, A2, . . . , Ad} where 



A, = 



Recall that the matrix A is said to be indecomposable if it cannot be repre- 
sented in a block-triangle form 






1 . 


. . 


. 


an 


a % 2 ■ 


■ aii . 


aid 


\ 


. 


. . 


■ 1 / 



.4 



B C 
D 



by any transposition of its rows and corresponding columns. The matrix A is 
indecomposable if and only if it has no proper non-zero invariant set spanned 
over some number of the basis vectors 



{0,0, 



,0}, 



1,2, 



Let || • || be the norm in R d defined by the equality ||x|| = |xi| + |x2| 



Set 



Q=-min{||(^-7)x|| : = 1}, 



P = - min{|o y I a« ^ 0}. 
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Example 1. The matrix set &(A) is irreducible iff the matrix A indecomposable 
and 1 is not its eigenvalue. In this case Xd[^(A)} > afi^ 1 . 

The next example was communicated to the author by E. Kaszkurewicz. Let 
Y{A) be the matrix set composed of the matrices A, V\A, V2A,. . . , VdA. Here 
A is a real d x d matrix with the entries Oy, and Vi, i — 1,2, ... ,d, are the 
diagonal matrices of the form 

V t = &\&g{v U ,V2i, ■ ■ ■ ,Vu, ...,V d i), 

where Vij = 1 for i ^ j, Vij = —1 for i = j. 

Let again || • || be the norm in R d defined by the equality ||x|| = |a;i| + |x 2 | + 
. ..+ \x d \. Set 

a = ^mm{\\Ax\\ : ||a;|| = 1}, ^ = min{|ay|: i^j,a y ^0}. 

Example 2. The matrix set 'f(A) is irreducible iff the matrix A is indecom- 
posable and non- degenerate. In this case Xd[V{A)\ > af3 d ^ 1 . 
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